Papers with translate-and-refine approach
Distilling Translations with Visual Awareness (P19-1)
Copied to clipboard
| Challenge: | Existing work on multimodal machine translation has shown that visual information is only needed in very specific cases, for example in the presence of ambiguous words where the textual context is not sufficient. |
| Approach: | They propose a translate-and-refine approach to multimodal machine translation where images are only used by a second stage decoder to generate a good first draft translation and to improve over this draft. |
| Outcome: | The proposed approach generates a good translation and improves over the draft by making better use of the target language textual context and making use of visual context. |